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Abstract 

Sign type spectra are an important tool in the investigation of spectral properties of selfad- 
joint operators in Krein spaces. It is our aim to show that also sign type spectra for normal 
operators in Krein spaces provide insight in the spectral nature of the operator: If the real part 
and the imaginary part of a normal operator in a Krein space have real spectra only and if the 
growth of the resolvent of the imaginary part (close to the real axis) is of finite order, then the 
normal operator possesses a local spectral function defined for Borel subsets of the spectrum 
which belong to positive (negative) type spectrum. Moreover, the restriction of the normal 
operator to the spectral subspace corresponding to such a Borel subset is a normal operator 
in some Hilbert space. In particular, if the spectrum consists entirely out of positive and neg- 
ative type spectrum, then the operator is similar to a normal operator in some Hilbert space. 
We use this result to show the existence of operator roots of a class of quadratic operator 
polynomials with normal coefficients. 



Introduction 

Recall that a bounded operator Nina Krein space {M*, [•,•]) is normal if NN + = N + N, where 
jV + denotes the adjoint operator of N with respect to the Krein space (indefinite) inner product 
[•,•]. In contrast to (definitizable) selfadjoint operators in Krein spaces, the knowledge about 
normal operators is very restricted. 

Some results exist for normal operators in Pontryagin spaces. The starting point is a 
result of M.A. Naimark, see ll27l . which implies that for a normal operator N in a Pontryagin 
space IIk there exists a JC-dimensional non-positive common invariant subspace for N and 
its adjoint A^ + . In [23, 30] spectral properties of normal operators in Pontryagin spaces were 
considered and, in the case IIi, a classification of the normal operators is given. 

There is only a very limited number of results in the study of normal operators in spaces 
others than Pontryagin spaces. In iPLD a definition of definitizable normal operators was 
given and it was proved that a bounded normal definitizable operator in a Banach space with 
a regular Hermitian form has a spectral function with finitely many critical points. Let us note 
that in this case the spectral function is a homomorphism from the Borel sets containing no 
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critical points on their boundaries to a commutative algebra of normal projections, see also 
(3). Some advances for Krein spaces without the assumption of definitizability can be found 
in 0. We mention that |3| contains some perturbation results for fundamentally reducible 
normal operators. The case of fundamentally reducible and strongly stable normal operators 
is considered in J6] |7) . 

On the other hand, the spectral theory for definitizable (and locally definitizable) selfad- 
joint operators in Krein spaces is well-developed (see, e.g., ll2Tl[T5l l4l and references therein). 
One of the main features of definitizable selfadjoint operators in Krein spaces is their property 
to act locally (with the exception of at most finitely many points) similarly as a selfadjoint op- 
erator in some Hilbert space. More precisely, the spectrum of a definitizable operator consists 
of spectral points of positive and of negative type, and of finitely many exceptional (i.e. non- 
real or critical) points, see 11201 . For a real point A of positive (negative) type of a selfadjoint 
operator in a Krein space there exists a local spectral function E such that (E(8)J$f, [•,•]) 
(resp. (E(8)Jf ) — [- , •])) is a Hilbert space for (small) neighbourhoods 8 of X. 

In lfl9l l22ll a characterization for spectral points of positive (negative) type was given in 
terms of normed approximate eigensequences. If all accumulation points of the sequence 
([x„,x„]) for each normed approximate eigensequences corresponding to X are positive (resp. 
negative) then A is a spectral point of positive (resp. negative) type. Obviously, the above 
characterization can be used as a definition for spectral points of positive (negative) type for 
arbitrary (not necessarily selfadjoint) operators in Krein spaces (as it was done in 121). It is 
the main result of this paper that also for a normal operator N in a Krein space (J^, [• , •]) 
positive and negative type spectrum implies the existence of a local spectral function for N. 
However, for this we have to impose some additional assumptions: The spectra of the real 
and imaginary part of N are real and the growth of the resolvent of the imaginary part (close 
to the real axis) of N is of finite order. Under these assumptions we are able to show that N 
has a local spectral function E on each closed rectangle which consists only of spectral points 
of positive type or of points from the resolvent set of N. The local spectral function E is then 
defined for all Borel subsets 8 of this rectangle and E(8) is a selfadjoint projection in the 
Krein space (Jf , [•,■]). It has the property that (E(8)J4?, [•,•]) is a Hilbert spaces for all such 
8. This implies that the restriction of N to the spectral subspace E(8)J^ is a normal operator 
in the Hilbert space (E(8) Jf, [-, ■]). 

We emphasize that this result provides a simple sufficient condition for the normal op- 
erator N to be similar to a normal operator in a Hilbert space: If each spectral point of N is 
of positive or of negative type and if the spectra of the real and imaginary part of N are real 
and the growth of the resolvent of the imaginary part is of finite order, then N is similar to a 
normal operator in a Hilbert space. Actually, in the final section, we use this result to prove 
the existence of an operator root of a quadratic operator pencil with normal coefficients. 

1 Some auxiliary statements 

In this section we collect some statements on bounded operators in Banach spaces. As usual, 
by L(X,Y) we denote the set of all bounded linear operators acting between Banach spaces X 
and Y and set L(X) :— L(X,X). In this paper a subspace is always a closed linear manifold. 
The approximate point spectrum a ap (T) of a bounded linear operator T in a Banach space X 
is the set of all X 6 C for which there exists a sequence (x„) C X with \\x„ || = 1 for all n 6 N 
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and (T — X)x n — > as n — > °°. A point in a ap (T) is called an approximate eigenvalue of T. 
We have 

da{T) c ffop(r) c ff(r), (l.i) 

see flU Chapter VII, Proposition 6.7]. Therefore, a ap (r) ^ if X ^ {0}. 

The following Lemmas ll .1141 ,3l are well-known. For their proofs we refer to Lemma 0.11, 
Theorem 1.3, Theorem 0.8 and Corollary 0.13 in [|28l . 

Lemma 1.1. Let S and T be two commuting bounded operators in a Banach space X and let 
p be a polynomial in two variables. Then 

a(p(S,T)) c {p{k,n) : A e a(S), ju e a(T)}. 

If, in addition, the operators S +T and i(S — T) have real spectra, i.e. 

a(S + T)cU and a(S-T)cM (1.2) 

then the following identity holds: 

a(p(S,T)) = {p(X,I):Xeo(S)}. 

In particular, we have 




— {ReA : A e 

= {ImA : A e a(S)}. 



Lemma 1.2. Let T be a bounded operator in a Banach space X and let Jz? be a subspace of 
X which is invariant with respect to T. Then 

o(T\J?)co(T)Up b (T), 

where Pb(T) is the union of all bounded connected components of p(T). In particular, if 
(7(7) C K, we have 

ff(r|jSf) C a(T). 

Lemma 1.3 (Rosenblum's Corollary). Let S and T be bounded operators in the Banach 
spaces J%~ andW, respectively. If (7 (S) (1(7 (T) — 0, then for every Z £ L(& , 3£) the operator 
equation 

SX-XT = Z 

has a unique solution X G L(^V, In particular, SX — XT implies X — 0. 

Remark 1.4. We mention that a much more general version of Lemma [T31 can be found in 
ifTTl Theorem 3.1]. In addition, an explicit formula for the solution X is given in ifTTI . Here, 
we will only make use of the last assertion in Lemma fOI 
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Let T be a bounded operator in a Banach space and let Q C C be a compact set. We 
say that a subspace Jzfg is the maximal spectral subspace of T corresponding to Q if Jzfg is 
T-invariant, a(r|Jz?g) C o(T) (~l 2 and if _Sf C Jz?g holds for every T-invariant subspace Jzf 
with o(T\Jif) C 2. Recall that such a subspace is hyperinvariant with respect to T, i.e. it is 
invariant with respect to each bounded operator which commutes with T (see [9 , Chapter 1, 
Proposition 3.2]). 

If the spectrum of the bounded operator T is real, we say that the growth of the resolvent 
of T is of finite order n, n £ N \ {0}, if for some c > there exists an M > 0, such that 

0<|ImA|< c =s> IKr-A)- 1 !! < (1.3) 

Since the function p ^ M /p",Q < p < 1, satisfies the Levinson condition (cf. 11241 formula 
(2.1.2)]), it is a consequence of ( 11.31 ) and [24, Chapter II, §2, Theorem 5] that to each compact 
interval A the maximal spectral subspace _2a of T corresponding to A exists. 

By r(T) we denote the spectral radius of a bounded operator T in a Banach space. 

Lemma 1.5. Let T ^ be a bounded operator in a Banach space with real spectrum such 
that the growth of its resolvent is of order n. Then for all k >n we have 



< 2 <r ||r|| <r -"(M+||r||"- 1 )r(r), 



w/zere M = sup{ | ImA |" IKr-A)" 1 1| :0< |ImA| < ||r||}. 

Proof. For p > we define the function 

M(p) = sup{|ImA|"||(r-A)" 1 || :0< |ImA| <p}. 

It is obvious that this function is non-decreasing and continuous. Therefore, the infimum 
M(0) :=inf p>0 M(p) exists. We haveM =M([|T||). 

Let k>n. Let ^ be the circle with center and radius p > r(T). For < | ImA | < p we 
have 

IIP--AJ-II < 0f CM) 

Observe that for j £ N, j > 1, the function A i-> A~ 7 (r — A) -1 is holomorphic outside of 
^ . Due to ||(r — A) -1 1| = 0(| A as |A| —*<*>, the Cauchy integral theorem and standard 
estimates of contour integrals we obtain 



Therefore, the relation 



/ l- J (T-l)- 1 dl = 0, j > 1. 



A ~P \ V ( k \<i2i-kf „2\k~J 



yields 



27n j^tf V A 



(T-X)- l dX= £ [.) (-p 2 ) k ~ j T 2J 

j=\k/2] \J 



-k 
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where \k/2] denotes the smallest integer larger than k/2. Since k > n and 
for A together with (ll.4l i this gives 



A~— p~ 



2|ImA| 



r*+ £ ( * ) (- p 2 ) k -iT 2j 



-k 



<2 k M{p)p 



k-n+l 



and hence 



< 



2 k M(p)p k -"+ £ f^p 2( ^ ;V1 ||r|| 2 ^M p. 



Letting p r(T) we obtain 



< ^2*ii#(r(r))||rf-"+£ I r 



\2(k-j)-l\\ T \\2j-k 



r(T). 



We haveM(r(r)) < M(||T||), which leads to the desired estimate with M = M(||r| 
For a finite interval A we denote by £(A) the length of A. 



□ 



Corollary 1.6. Let T be as in Lemma fOl Then there exists C > rac/i that for each k > n, 
eac/i A 6 d(r) anc/ eac/i compact interval A w/f/i A G A anof £(A) < \\T\\ we have 

(r|jSf A -A)* < 4*||r||*c-*(A), 

where Jz? A denotes the maximal spectral subspace ofT corresponding to A. 

Proof. We have ct(7a) C A, where r A := r| J?? A . Clearly, the growth of the resolvent of r A — A 
is of order n. Since ||r A -A|| < ||r|| + |A| <2||r|| andr(r A -A) < 1(A). LemmaO gives 
the estimate 

(r A -A)* <2 t (2||r||)^"(M + 2"- l ||r||' , - l )^(A) 

withM = sup{|Im J u|"||(r A -A- J Li)- l || :0< |Imju| < ||T A -A||}. As A is real, 

M<sup{|ImAl|"||(r-A-Ai) _l || :0< |Im/x| <2||r||} 
< S up{|Im^|"||(r-M)" 1 |l :0< |Im M | <2||r||}, 



which is independent of A, k and A. 



□ 



2 Spectral points of positive type of bounded operators in 
G-spaces 

Recall that an inner product space (Jff, [•,•]) is called a Krein space if there exist subspaces 
J$? + and Jf- such that [•,•]) and (Jf?_,—[- , •]) are Hilbert spaces and 



(2.1) 
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where + denotes the direct sum of subspaces. We refer to (12. U as a fundamental decomposi- 
tion of the Krein space (Jff, [•,•])• 

An inner product space (Jf , [•,•]) is called a G-space if is a Hilbert space and the 
inner product [• , •] is continuous with respect to the norm || • || on , that is, there exists 
c > such that 

\[x,y]\ <c||jc||||y|| foraUx,y G Jf. 

Let (• , •) be a Hilbert space inner product on Jf inducing || • || . Then the inner products (• , •) 
and [■ , •] are connected via 

[x,y] = (Gx.y), x,y<EJf, 

where G G L(jff') is a uniquely determined selfadjoint operator in (Jff, (■,■))■ It is well known 
that (Jtf, [•,•]) is a Krein space if and only if G is boundedly invertible, see, e.g. [8][T|. A 
bounded operator A in the G-space Jt? is said to be [• , -]-selfadjoint or G-selfadjoint if 

[Ax,y] = [x,Ay] (2.2) 

holds for all x,y G J4f. 

Remark 2.1. Note that in a G-space it is in general not possible to define a bounded adjoint 
with respect to [• , •] of a bounded operator. However, in a Krein space this is possible. In this 
case, the usual notion of selfadjointness in a Krein space coincides with [• , -J-selfadjointness 
in G-spaces. 

Spectral points of definite type, defined below for bounded operators in a G-space, were 
defined for [• , -J-selfadjoint operators in G-spaces in (221 an d in O for arbitrary operators 
(and relations) in Krein spaces. 

Definition 2.2. For a bounded operator A in the G-space (Jf , [• , •]) a point A G O ap (A) is 
called a spectral point of positive (negative) type of A if for every sequence (x„) with \\x n \\ = 1 
and ||(A — X)x n \\ — » as n — > °°, we have 

liminf [jc„,jc„] > ( limsup [x„,x„] < 0, respectively I . 

We denote the set of all points of positive (negative) type of A by d+(A) (a_(A), respectively). 
A set A C C is said to be of positive (negative) type with respect to A if every approximate 
eigenvalue of A in A belongs to <7 + (A) (<7_(A), respectively). 

Remark 2.3. If the operator A is [• , -J-selfadjoint, then the sets (T + (A) and C7_(A) are con- 
tained in K (cf. 11221 ). 

The following lemma is well known for selfadjoint operators in Krein spaces and [•,•]- 
selfadjoint operators in G-spaces (see e.g. |4][22)). The proof for arbitrary bounded operators 
remains essentially the same. However, for the convenience of the reader we give a short 
proof here. 

Lemma 2.4. Let A be a bounded operator in the G-space [• , •]). Then a compact set 
K C C is of positive type with respect to A if and only if there exist a neighbourhood % ofK 
in C and numbers £, 8 > such that for all x G Jif and each X G we have 

||(A-A)x||< £ W M>5|W| 2 . 

In this case, the set % is of positive type with respect to A. 



6 



Proof. Assume that K is a compact set of positive type with respect to A, i.e. KD G ap (A) C 
<7+(A). Let Ao £ K. Then it follows from Definition 12 . 21 and the properties of the points of 
regular type of A that there exist £o, 8q > such that for all x £ Jtf we have 

||(A-Ao>[[ <2£bW =>■ [x,x] > 8 \\x\\ 2 . 

From this we easily conclude that for all x £ Jf and all A £ C with |A — Ao < £o we have 

||(A-A)x||<£oH => [x,x]>$o\\4 2 - 

Since Ao was an arbitrary point in K, the assertion follows from the compactness of K. The 
converse statement is evident. □ 

One of the main results of |22| is that under a certain condition a [■ , -J-selfadjoint operator 
in a G-space has a local spectral function of positive type on intervals which are of positive 
type with respect to the operator. Let us recall the definition of such a local spectral function 
and the exact statement for [• , -]-selfadjoint operators. 

Definition 2.5. Let (.Jf 7 , [■,■]) be a G-space, A £ L(J4?) and S C C. A set function E mapping 
from the system £§(S) of Borel-measurable subsets of S whose closure is also contained in S 
to L(Jtf) is called a local spectral function of positive type of the operator A on S if for all 
QiQiiQi, ■ ■ ■ £ &(S) the following conditions are satisfied: 

(i) (E(Q)J^, [-,.]) is a Hilbert space and E(Q) is [■ , ■]- self adjoint. 

(ii) E(Q l nQ 2 )=E(Q 1 )E(Q 2 ). 

(iii) If Q\ , Q2, ■ ■ ■ £ @S{S) are mutually disjoint, then 

\k=l ) k=\ 
where the sum converges in the strong operator topology. 

(iv) AB = BA => E{Q)B = BE(Q) for every B £ L(Jtf). 

(v) o(A\E(Q)Jf)co(A)nQ. 

(vi) CT(A|(/-£(<2))jr)CCT(A)\e. 

Note that (ii) implies that E(Q) is a projection for all Q £ S3{S) and that from (iii) (or 
(v)) it follows that E(0) = 0. By C + (C~) we denote the open upper (lower, respectively) 
halfplane of the complex plane C. 

Theorem 2.6. Let A be a [■ , -\-selfadjoint operator in the G-space {J^ , [■ , •]). If the interval 
A is of positive type with respect to A and if each of the sets p(A) D C + and p(A) HC~ 
accumulates to each point of A, respectively, then A has a local spectral function E of positive 
type on A. For each closed interval 8 C A the subspace E(8)Jf? is the maximal spectral 
subspace of A corresponding to 8. 
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3 Locally definite normal operators in Krein spaces 



For the rest of this paper let (J^, [•,•]) be a Krein space. It is our aim to extend Theorem 
!2.6l to normal operators in Krein spaces. Recall that a bounded operator N in a Krein space 
(Jf?, [•,•]) is called normal if it commutes with its adjoint jV + , i.e. 

N + N = NN + . 

By definition the real part of a bounded operator C in a Krein space (J^, [•,•]) is the operator 
(C + C + )/2 and the imaginary part is given by (C — C + )/2i. It is clear that both real and 
imaginary part of an arbitrary bounded operator are [• , ]-selfadjoint. Moreover, it is easy to 
see that a bounded operator in (J^*, [•,•]) is normal if and only if its real part and its imaginary 
part commute. 

Lemma 3.1. Let N be a normal operator in the Krein space (J^f, [• , •]). IfReN and ImN 
have real spectra only, then o(N) — O ap (N). 

Proof. Assume that A £ a (N) \ G ap (N) . Then N-X has a trivial kernel and ran (N - A ) ^ Jf 
is closed. Hence, A £ a p (N + ). Set Jz? := ker(N + — A). This subspace is AMnvariant. By 
Lemma [L2l the operators ReAf|Jz? and ImAf| Jz? have real spectra. Thus, by Lemma [TTTl (with 
S = N + \5f and T =N\Jzf) we conclude that o(N\5?) = {ju : n e a{N+\^)} = {A}. Hence, 
A £ a ap (N\Jf) C o ap {N). A contradiction. □ 

The following theorem is the main result of this section. 

Theorem 3.2. Let N be a normal operator in the Krein space (Jf 7 , [• , •]). IfReN and ImN 
have real spectra and the growth of the resolvent of ImN is of finite order, then N has a local 
spectral function of positive type on each closed rectangle [a,b] X [c,d] which is of positive 
type with respect to N. 

Proof. Let [a,b] x [c,d] be of positive type with respect to N. Together with Lemma [3TT1 we 
have 

([a,b] x [c,d])na(N) c a+(N). 

By Lemma [2~4l there exist an open neighbourhood of [a,b] x [c,d] in C and numbers 
e,5 £ (0,1) such that 

A e^r, xe Jf, \\(N-X)x\\ <e\\x\\ =^ [x,x] > 8\\x\\ 2 . (3.1) 

By Corollary 1 1.61 there exists a value T > such that for each compact interval A with length 
£(A) < t and any A £ A n a (ImN) we have 



tyk— 1 git 

< = — for all k = k ,k + 1,... ,2k , (3.2) 

2 k 



where £0 is the order of growth of the resolvent of ImAf and Jz?a is the maximal spectral 
subspace of ImAf corresponding to the interval A. 

The proof will be divided into three steps. In the first step we define the spectral subspace 
corresponding to rectangles Ai x A2 C % with l{t^i) < X. In the second step we prove some 
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properties of the spectral subspaces defined in step 1 . In the third step we define the spectral 
subspace corresponding to the rectangle [a,b] x [c,d] and complete the proof. 

1. Let A] and A be compact intervals such that A[ x A C f and £(A) < x. Note that 
the inner product space (,£a, [■,•]) is a G-space which is not necessarily a Rrein space. Since 
a maximal spectral subspace is hyperinvariant (see, e.g. [9 1), the space «5fA is invariant with 
respect to N, N + , ReN and ImN. By A , Bo, No and Nq.+ denote the restrictions of ReN, 
ImN, N and A^ + to j^a, respectively. Then we have, see Lemma [L2l 

a(A ) c a (Re A 7 ) c K and a(B ) c a{lmN) n A. (3.3) 

Moreover, from A^o = Ao + iBq, No.+ = Aq — Wo, (13.3b and Lemma fTTI we conclude 

a(A Q ) = {ReA : A G a(N Q )} and a{B ) = {ImX : X e a(N )} 7 

hence 



The operator Aq is obviously | 



a{N ) C <r(A ) x A, 
-selfadjoint. In the following we will show 

Ain ct(A ) C a+(A ). 



(3.4) 



To this end set 



e := mm 



2' V {\\lmN\\ + r(lmN))j- 1 



We may assume that ImN 7^ 0. Otherwise, the assertion of Theorem l3.2l follows directly from 
Theorem l2.6l We will show that for all a G Ai n <7(Aq) and for all x g J^a we have 



||(A -a)*||<£H 



t,x] > S\ 



which then implies (13.41 1. see Lemma l2~4l If a (ImN) Pi A = 0, then it follows from (13.3b that 
= {0}, and nothing needs to be shown. Otherwise, there exists j3 G An a(lmN). Let 
a G Ai n ct(Ao) and x G S£a, \x\ = 1, and suppose that ||(Ao — a)x\\ < e. Let us prove that 
for all 7 = 1,..., 2Icq we have 



\(Bo-P) J x\ 



< 



(3.5) 



For /' = ko, . . .,2ko this is a direct consequence of ( 13.2b . Assume now that ( 13.5b holds for all 
./' G {£, . . . ,ko} where k G {2, . . . ,ko} but does not hold for j = k— 1, i.e. 



Then we have 



(N Q -(a + iP)) 



(B -P) 



(Bo-py-'x 



k-1. 



> 



8 k - 2 e k - 1 
2 k - 1 



(3.6) 



II (£o-/3 



< 



fio-jSir^KAo-aWI + IKBo-jS)^!! 



|(2?o-/5)*- 1 ac 



ik-1 



< 



< 



(\\lmN\\+r(lmN)) 



k-1 



lk-1 



gk-l E k 



§k-2 £ k-l 2 k 



2 ~ 
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As a + G Ai xAcf, it follows from OTTb that 

(B -P) k - l x (B -P) k - l x 



8< 



(B -P)^x\\'\\(B Q -p) 



< 



\(Bo-P) 



2k-2^ 



\(B -P) 



*-l v ||2' 



Owing to k < 2k — 2 < 2ko, relation (13 ,5b holds for j = 2k — 2 by assumption, and thus 



S.2k-4 P 2k-2 Sk-2 p k-l 

(B -Pf^x < V^-l || (Bo -P)^x\\ < yj = 

follows. But this contradicts ( 13.6b . Hence, (13.51 > holds for j = k—1, and, by induction, for 
7 = 1. Hence, 

\\(N-(a + ip))x\\ < \\(A -a)x\\ + \\(B -p)x\\ < e. 

By ( 13.11 ). this yields [x,x] > 8 and ( 13.41 ) is proved. 

Due to Theorem l2.6l the operator Aq £ L(_S?a) has a local spectral function of positive 
type on Aj , and the subspace 

^A,xA : = £a(Ai),2a 

is the maximal spectral subspace of Aq corresponding to Aj. Moreover, xA is a Hilbert 
space with respect to the inner product [•,•]. Since J#A t x a is invariant with respect to both N 
and Af + , the [• , -]-orthogonal complement 

^4fL = {yeJf: M = for all x G Jf Al xa} 

is also N- and Af + -invariant and (j&AixA' [•,•]) is a Krein space, see e.g. ETTl . Moreover, we 
have 



(N\Jf A 



A, xA 



KA] xA- 



2. Let 2:=Ai x A C ^ be a rectangle as in step 1. By Q (A') we denote the complex 
(real, respectively) interior of the set Q (A, respectively). In this step of the proof we shall 
show that the subspaces J$?q and JPq^, defined in the first step, have the following properties. 

(a) a(N\Jf Q )ca(N)nQ. 

(b) If C is a subspace which is both N- and Af + -invariant such that 



a{N\Jtj C Q, 



then J( C 3^q. 

(c) If jtf>Q = {0} then Q C p{N). 

(d) a(iV|^W) ca(N)\Q. 



(e) If the bounded operator commutes with AT then both and J^q^ are B-invariant. 

(f) ,3^q is the maximal spectral subspace of N corresponding to Q. 
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By Lemma fTTZl and J3.3b we have 

ff(Im(jV|jr e )) = o(B \Mq) C a (Bo) C A. 

In addition, 

a(Re{N\Jf Q )) = a(A |^f Q ) C Ai. 
From this and Lemma fTTl we obtain 

g(N\J#q) C Q. 

Since the spectrum of a normal operator in a Hilbert space coincides with its approximate 
point spectrum, (a) follows. 

Let jjt C J$? be a subspace as in (b). By Lemma fTTl we have 

a{\mN\^) c A and o(ReN\„df) c A,. 

As _2a is the maximal spectral subspace of ImN corresponding to A, we conclude from the 
first relation that .,# C .2a- From the second relation we obtain (b) since J%q is the maximal 
spectral subspace of ReN\J?A corresponding to the interval Ai, cf. Theorem l2.6l 

Let us prove (c). By definition of J^q it follows from Jif Q = {0} that A'j C p (R&N\J£a). 
Hence, by Lemma fTTl we have 

A|xM c p(N\£f A ). (3.7) 

Let J be a closed interval which contains cr(ImiV) and let 81 and 52 be the two (closed) 
components of /\ A 1 . By «Sfg and denote the maximal spectral subspaces of ImAf corre- 
sponding to the intervals 8i and 82, respectively. Set 

-2a c : = -^5, + -^52- 

Obviously, we have 

oQmN\J&Ac) c 81U82. (3.8) 
And by |24] Chapter II, Theorem 4] and flU Chapter I, §4.4] we have 

^ = j£f A + J2k. (3.9) 

It is an immediate consequence of (b) that ker(N — A ) C J%q = {0} for A G Q\ Hence, due to 
(13771 ) and ( T3~9l . it remains to show that Q C p(N\ J£\c). But this follows directly from (l3~8l l 
and Lemma ITTI 

Set N := N\J&q . In order to show (d) we prove 

C\(<r(A0\e) C p(N). (3.10) 

Since 

C \ (ff(JV)\fi) = p (N) U Q l U {A e dQ : $(X n ) C a(N) \ Q with Jim A„ = A}, 
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and p (N) C p (N) by Lemma [37X1 it suffices to show 

Q''U{A G<9g: ^(A„) C a(iV)\Q with lim A„ = A} c p(N). (3.11) 

Let A be a point contained in the set on the left hand side of this relation. Then there exists a 
compact rectangle R = A\ x A' C ^ with A e R\ l(A') < X and 

o{N)C\R C Q. 

Observe that the normal operator N in the Krein space Mq satisfies the conditions of Theo- 
rem !3.2l In particular, relation (I3.lt holds with the same values e and 8 and with N replaced 
by N. Hence, there exists a subspace Mr of Mq which is N- and N + -invariant and has the 
properties 

(a) o(N\Mk) c RDa(N), 

(c) M R = {0} =► R'cpiN). 

By virtue of (b) we conclude from (a) and Lemma [3~TI that Mr C Mq. But since Mr is also 

a subspace of Mq , we have Mr = {0} which by (c) implies R l C p(N). Hence, A € p(A) 
and therefore (13.1 11 1 holds. 

In order to prove (e) let Q n = A' n x A" C ^ be closed rectangles such that £(A'{) < T, 
2 C gj, for all n G N and 

oo 

QlD (&=)... and e=f)2»- 

n=\ 

From (a) and (b) it follows that Mq C |X=i ■ Now, it is not difficult to see that C\gc 
P^in^i^eJ, and (b) gives 

^e=n^e„- (3-12) 
«=i 

Let £(2) an d E(Q n ) be the [•, ] -orthogonal projections onto the Hilbert spaces Mq and 
Mq u , respectively. As these spaces are invariant with respect to both N and N + , the pro- 
jections commute with N. Let B be a bounded operator which commutes with N and let 
B Q G L{Mq,M) be the restriction of B to Mq. We obtain 

(iV|J^W) [{l-E{Q n ))B Q \ = (I-E(Q n ))NBQ = [(I-E(Q n ))B Q }(N\M Q ). 

The spectra of N\Mq^ and A|j£g are disjoint by (a) and (d), and Rosenblum's Corollary 
(Theorem Ol implies" (/ ~E(Q„))B Q = 0, i.e. BMq C for every n G N. By ( l3~T2b this 

yields C Mq. Similarly, one shows that BM Q ^ ] C ^g ±] for all n G N. From 

c.L,{ifW: fle N} ll| =n4„ 
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and (13 . 1 2b we deduce 

Hence, forx S J%q there exists a sequence (jc*) with each x* in some -^g^ such that x\ —> x 

as A: — > oo. Since Bxjt £ and Bxj — >• Bx as & — >• «>, we conclude fix € . 

After all which has been proved above, for (f) we only have to show that every .^-invariant 
subspace ^# C J$? with a(N\.^) C Q is a subspace of Let ^# be such a subspace. Then 
let (Q„) be a sequence of rectangles as in the proof of (e). From 

("\>*t ] ) [{I-E(Qn))\^\ = [{I-E{Q n ))\jf\ (N\Jl) 

and Rosenblum's Corollary we conclude (/ — E(Q n )).,df = {0}. Therefore, j$ C J#Q n for 
every n e N and ^# C J£g follows from ( 13.121 i. 

3. In this step we complete the proof. Let Q\ = [a, fo] x Ai C ^ and ^2 = [«, &] x A2 C % 
such that £(Aj) < T for j = 1,2 and assume that A] and A2 have one common endpoint. Then 
Q '■= Q\ U 62 = x (Ai U A2) is also a closed rectangle. Define 

,ye Q ■.= jgfa + ,ye Ql = jt 2i [+} (j^f n jt Q2 ) . 

This is obviously a Hilbert space (with respect to [• , •]) which is both N- and Af + -invariant. 
Let us prove that the statements (a)-(f) from part 2 of this proof also hold for M'q. In step 
2 the statements (d)-(f) were proved only with the help of (a)-(c). Here, this can be done 
similarly. Hence, it is sufficient to prove only (a)-(c). By (ay)-(cy) denote the corresponding 
properties of Mq., j — 1,2. Statement (a) holds since N\J£q is a normal operator in the 
Hilbert space (J&q, [-,-]) and 

o(N\Jf Q ) = a(N\.Jf Ql ) U o(N\3tf£ ] n.*k) C & U a(N\J^Q 2 ) cQrU Q 2 . 

For (b) let .M be a N- and jV + -invariant subspace with g(N\JK) C Q. Denote by JS%^ C Ji 
be the maximal spectral subspace of \mN\j#t corresponding to Ay, j = 1,2. Then, by Lemmas 
PandP 

a{N\setf) c(Mx Ay) n (tr(JV|^)Up 6 (AT|^)) c(tx Ay) ng = gy. 

From (by) we obtain Jgf^f C JVq., 7 = 1,2. And since ^ = if^f + JSf^f (see fl24] Chapter 
II, Theorem 4 and Chapter I, §4.4]) we have Jt C ^g. 

Suppose that J#g = {0}. Then ^ = j£g 2 = {0} and hence Qi UQ 2 C p{N) by (ci) 
and (C2). Let R = [a,b] x [ci,C2], where cy is the center of Ay, j = 1,2. Then C2 — c\ < T. 
From <j{N\J?k) C /? C g and (b) it foUows that Jf R C Mq = {0}. Hence, R l C p(AQ which 
shows (c). 

Now it is clear that for Q = [a,b] x [c,d] we choose a partition c = to < t \ < ■■■ < t m = d 
of [c,d] such that — < T, k = 0, . . . ,m— 1, and define 

:= H l-^Q m) 
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where := [a,b] x [fjt_i,fjfc], k= 1, . . . ,m. This subspace is then a Hilbert space with respect 
to the indefinite inner product [• , •] with the properties (a)-(f). Moreover, J#q is both N- and 
Af + -invariant. Hence, N\J%q is a normal operator in the Hilbert space {3%q, [•,•]) and has 
therefore a spectral measure Eq. By E(Q) we denote the [• , -]-orthogonal projection onto 
J£q. It is now easy to see that 

E(-):=E Q (-)E(Q) 

satisfies conditions (i)-(iii) from Definition 12.51 The remaining conditions (iv)-(vi) follow 
from (e), (a) and (d), respectively. Hence, E is the local spectral function of positive type of 
N on Q. □ 

Remark 3.3. It is clear that under the conditions of Theorem 13. 2 1 the operator N possesses 
a spectral function of positive type on open sets S of positive type. In order to define E(W) 
for W S £§(S), cover W with finitely many closed rectangles Q\ , . . . , Q„ € 5§(S) and define 
the spectral projection E(Q) for Q = Q\ U . . . U Q n similarly as in the last part of the proof 
of Theorem 13.21 Then N\E(Q.)Jtf is a normal operator in the Hilbert space E{Q)J>t with 
spectrum in Q and spectral measure Eq, and E(W) can be defined via Eq(W)E(Q). 

Remark 3.4. The statement of Theorem l3.2l also holds if the growth condition on the imag- 
inary part of N is replaced by the (local) definitizability of ImN in the sense of P. Jonas (cf. 
fl3)) over a complex neighborhood of [c,d]. 



4 Spectral sets of definite type 

In this section we show that Theorem l3.2l also holds in the situation when the real part of 
is allowed to have nonreal spectrum but the set of definite type with respect to is a spectral 
set. 

Lemma 4.1. Let N be a normal operator in the Krein space (Jif, [")"]) an d let o be a spectral 
set ofN with 

ana ap (N)ca ++ (N). (4.1) 

Then the Riesz-Dunford projection Q of N corresponding to is selfadjoint in the Krein 
space [•,•]) and the corresponding spectral subspace QJt? is invariant with respect to 
both N andN + . Moreover, we have 

Oa P (N\Qje) C o ++ {N\Q,3f). 

Proof. Since Af is normal, Q is also normal, hence it commutes with Q + . Moreover, Q + 
is the Riesz-Dunford projection corresponding to A^ + and the set {A : X G % }, so Q + also 
commutes withAf. Thus, the projection Q Q + Q projects on a subspace j% which is invariant 
with respect to N. This subspace is neutral. Hence, from (14. U it follows that a ap (N\^i() = 0. 
This is only possible if = {0}, and we conclude 

Q = Q + Q, 

that is, Q is a selfadjoint projection. The last statement follows from <7 a p{N\QJt?) = (TP 
a ap (N). - □ 
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Theorem 4.2. Let N be a normal operator in the Krein space (Jf, [• , •]). Let O be a spectral 
set ofN with 

ana ap (N) c a++(N), 
and let Q be the Riesz-Dunford projection corresponding to O and N. Assume that 

a(JmN\QJf) C R {or a(ReN\QJ^ ) C M) 

and that the growth of the resolvent oflmN\QJ4? (ReN\QJtf, respectively) is of finite order. 
Then the spectral subspace QJ^/f equipped with the inner product [• , •] is a Hilbert space. 
Hence, the restriction N\QJtf is a normal operator in the Hilbert space {QJf ,[•>•]) and, 
therefore, possesses a spectral function. 

Proof. By Lemma |4~T1 the space (QJtf, [•,•]) is a Krein space and QJif is -invariant. 
Hence {N\QJf) + = N + \QJ{f and N\QJf is normal in QM". Therefore it is no restriction 
to assume a ap (N) = a++(N), o(lmN) c R and that the resolvent of ImN is of finite order 
Icq for some Icq £ N. For each compact interval A denote the maximal spectral subspace 
corresponding to ImN and A (which exists due to [24 1) by Jz?a- 

It is a consequence of Lemma |2~4| that there exist e, 8 > with 8 < 1 such that for all 
H&K, 

K:={X + ib:Xe a{ReN), b e a (ImN)}, 

and all x e Jf we have 

\\(N-n)x\\<e\\x\\ [x,x] >8\\x\\ 2 . (4.2) 

Let b 6 a(ImA^). From Corollarv ll.6l it follows that there exists a compact interval A with 
center b such that 



(lmN\^f A -by 



< for all k = Icq,Icq + 1, . . .,2k , (4.3) 



where ko is the order of growth of the resolvent of ImN. 

Since the subspace JzfA is hyperinvariant with respect to ImN, it is ReAMnvariant. The 
operator ReAf|J??A is a bounded operator in Jz?a which is [■ , -]-selfadjoint in the sense that 

[(ReN)x,y] = [x, (ReN)y] for alljc,y G JSf A , 

cf. d23t . We define 

£:=lmn l2' 2;(l|Im j V)| + r(Im j V)y-' :; = 2 -^ Q 



In a similar way as in step 1 of the proof of Theorem l3.2l it is shown here that from || (Re AT - 

II 



X)x\\ < e\\x\\ forxeJzf A , ||x|| = 1 and A e o(ReN\3? A ) it follows that \\(lmN-b)x\\ < §||*|| 



and thus 

\\(N-(X + ib))x\\ < \\(ReN-X)x\\ + \\(lmN-b)x\\<e. 
Thus, with (14.21 ). we obtain 

CT ap (ReA^ A ) C o + (ReN\3? A ). 
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Since o+ (ReA| JSf A ) C R (see Remark|23]l we conclude that C\lcC\ O ap (ReN\ Jf A ). But 
as Re A| Jz? A is bounded we even have C\lcp (Re A| Jzf A ) and thus 

cr(ReA|Jz? A ) = o a p{ReN\3? A ) = o+(ReA|Jz? A ). 

It is now a consequence of lf22l Theorem 3.1] that (J?a, [• , •]) is a Hilbert space. It is easily 
seen that also the subspace JSf[ is invariant with respect to ImA. Consider the operator 
A := haN\ J^ A . If A i is a compact interval which is completely contained in the inner of 

A, then by (23) there exists a spectral subspace _§f A , C Jtfj^ of A such that ff(A|j2 Al ) C Aj. 
But as this implies <r(ImA^|^f Al ) C A and «5f A is a maximal spectral subspace, we obtain 

Jz? Al C Jz? A and thus jgf A) C Jz^nifj" 11 = {0}. Hence, e p^mA^I^ 1 ) follows. 

We are now ready to prove b £ <7 ++ (ImAf). Let (x„) C be a sequence with ||jc„|| = 1, 
« G N, and (ImiV - fo)x„ as n ->• oo, Write 

x„ = m„ + v„ with «„ G «5f A , v« G • 

From (ImN - b)x„ ^ it follows that also (ImN - b)v n — > 0, and b G p (Im.N\JZ'£ L ' ) implies 
v„ — >• as n — > °°. From the fact that (J2? A , [•,•]) is a Hilbert space we conclude 

limsup [x„,x„] = limsup ([u„,u„] + [v„,v„]) = limsup[M„,M„] > 0. 

n— n— >°<> n— t-°° 

Since b G cr(ImA^) was arbitrary, we have o(lm.N) = a++(lmN), and it follows from, e.g., 
1221 Theorem 3.1] that (JV, [•,•]) is a Hilbert space. □ 

In (6) a bounded normal operator N in a Krein space is called strongly stable if there 
exists a fundamental decomposition ( 12.11 ) such that and ML are invariant subspaces with 
respect to N with g(N\J%+) D g(N\J4?-) = 0. The following Theorem 14. 3 1 provides a new 
characterization of strongly stable normal operators in Krein spaces. We say that an operator 
T G L(J^) is similar to a selfadjoint (normal) operator in a Hilbert space if there exists a 
Hilbert space scalar product (• , •) on ffi which induces the topology of (J^ 7 , [•,•]) such that 
N is selfadjoint (normal, respectively) in the Hilbert space (^ 1 (• , •)). 

Theorem 4.3. A normal operator N in the Krein space (3l?\ [•,•]) is strongly stable if and 
only if 

(7(A) = o++ (N) U a (A), (4.4) 

a(lmN) c R (or a(ReA) C M) (4.5) 

and 

the growth of the resolvent oflmN (Re A, respectively) is of finite order. (4.6) 
In particular, in this case, N is similar to a normal operator in a Hilbert space. 

Proof. Let N be strongly stable. Then (14.4b follows and ( 14. 5t and the growth condition follow 
from the fact that \mN\M± and RtN\,j^± are selfadjoint operators in the Hilbert spaces 
(J^ + , [-,-]) and (jgL, -[•,•]), respectively. 
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For the converse observe that the sets c ++ (N) and a (N) are open in o(N), see Lemma 

12.41 Therefore, o++(N) and a (N) are spectral sets. Let Q + and Q be the spectral pro- 
jections corresponding to these sets, respectively. Then, since Q+Q- = 0, due to Theorem 
14.21 the operator J := Q + — <2_ is a fundamental symmetry in (Jtf?, [•,•]) with the desired 
properties. 

In order to show the last statement of Theorem l4.3l we denote by N* the adjoint of N with 
respect to the Hilbert space inner product [/•, •]. Then, from A'* = A^ + it follows that A' is a 
normal operator in (Jff, [J •,-])■ □ 

The following theorem shows that ( 14.5b and (14.61 > in Theorem l4.3l can be replaced by the 
condition that ReN and ImN have real spectra and that N is similar to a normal operator in a 
Hilbert space. 

Theorem 4.4. Assume that the normal operator N in the Krein space (34?, ['>']) is similar to 
a normal operator in a Hilbert space and that (j(ReN) C K and <y(lmN) C K. Then ReN 
and ImN are similar to self adjoint operators in a Hilbert space. In particular, their resolvent 
growths are of first order. 

Proof. Let 38 denote the set of all Borel-measurable subsets of C and set Q* := {X : X G Q} 
for gG^ 1 . Moreover, let (■ , •) be a Hilbert space scalar product on with respect to which 
N is normal, let G G L(Jf?) such that [• , •] = (G-, •) and let E be the spectral measure of the 
normal operator N in (Jf , (G-, •))■ Then E*, defined by := E(Q*), Q e 38, is the 

spectral measure of Af*. It follows from the properties of that the function E + given by 
E+(Q) = G~ l E t (Q)G = (g)+ = E(Q*) + , Qe.@,isa countably additive resolution of the 
identity for A^ + = G~ l N*G (where we here now use the notions of lTT2l Section XV.2]), that 
is, A^ + is a spectral operator in the sense of Dunford IfPJl . 

Note that for any compact rectangle Q C C of the type Q = [a,b] x [c,d] the projection 
E(Q) (and therefore the projection E*(Q)) commutes with any operator that commutes with 
N, so the operators Re(N\E t (Q)Jf) and lm(N\E t (Q)Jf) have real spectra (cf. Lemma [L2l . 
From Lemma [TTI we conclude that a(N + \E*(Q)J4?) C Q. Since E + (Q)Jf is the maxi- 
mal spectral subspace of A^ + corresponding to Q (see, e.g., |9j Example 2.1.6(ii)]), we have 
E*(Q)J^ C E + (Q)Jf and hence 

E{Q*) + E{Q*) =E + (Q)E,{Q) =E*(Q) =E(Q*). 

Therefore, for all compact rectangles gcC the projection E(Q) is selfadjoint in the Krein 
space [• , •]). Since the system of compact rectangles in C is stable with respect to in- 
tersections and generates S3, it follows that E(Q) = E(Q) + for all Q G 38. This implies that 
for all Q G 38 we have GE(Q) = GE(Q)+ = GG~ l E(Q)G = E(Q)G and thus GN = NG. 
Consequently, A^ + = G~ l N*G = N*, which implies the assertion. □ 

Remark 4.5. Theorem 14.41 shows that the growth of the resolvent of ImAf and ReAf under 
the conditions of Theorem l4.3l are of first order. However in the formulation of Theorem 14. 3 1 
we choose the (formally) weaker Condition (14.61 l. 

5 Quadratic operator pencils with normal coefficients 

In this section we apply our results to operator pencils. A standard description of damped 
small oscillations of a continuum or of small oscillations of a pipe, carrying steady-state fluid 
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of ideal incompressible fluid, is done via an equation of the form 

Tz+Rz + Vz = 0, (5.1) 

where z is a function with values in a Hilbert space and V and R are (in general) unbounded 
operators. As a reference (especially for non-selfadjoint coefficients) we mention here only 
lE9lfl4ll and Ifl6l Chapters 6.4 and 6.51. 

The classical approach (see [17 18 1) to such kind of problems is, under some addi- 
tional assumptions (V uniformly positive and the closures of the operators V~ l / 2 TV~ 1 / 2 and 

y-l/2 w -l/2 

are bounded) to transform the equation in (15. It via u = V l l 2 z into 

Eii + Fu + u = 0, (5.2) 
with bounded operators E and F . If one is interested in finding solutions of the form 

u{t) =e a ~ 1 <j> , 

with a constant vector <j>o, then ( 15.21 ) can be written (after multiplication by A 2 ) as 

(l 2 I + XE + F)<j) = 0. (5.3) 

In the sequel, we will investigate quadratic pencils of the form ( 15. 3t with E =AC and F = C 2 , 
where 

C is a bounded normal operator in a Hilbert space H (5.4) 

and 

A is a bounded selfadjoint operator in H which commutes with C. (5.5) 
That is, we investigate the operator pencil L, 

L(A) := X 2 I + A.AC + C 2 . (5.6) 

As usual, a value A for which the equation L(X)<p = has a solution ^ is called an 
eigenvalue of the operator pencil L and the spectrum <j(L) of L is the set of all complex 
numbers A for which the operator L(A ) is not boundedly invertible. In many cases it turns out 
(see, e.g., lfT7l[T8"l ) that a successful investigation of the spectral properties of L is achieved 
by studying the operator roots Z of the quadratic operator equation 

Z 2 +ACZ + C 2 = 0. (5.7) 

If there exists a bounded operator Z\ which is an operator root, i.e., a solution of (15. 7} , 
then any eigenvalue (eigenvector) of Z\ is also an eigenvalue (eigenvector, respectively) of 
the operator pencil L. Moreover da(Z\) C o{L) (see 11251 Lemma 22.10]) and the operator 
pencils L decomposes into linear factors 

L(A) = (A7-Zi)(A/-Zi), 

where Z\ = —AC — Z\ . 

The following theorem on the existence of an operator root of ( 15.7b shows how our previ- 
ous results can be applied. 
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Theorem 5.1. Assume that the coefficients A and C of the operator pencil L(A) in 
satisfy ( 15.4b and ( 15. 51 ). Define on the Hilbert space := H x H an inner product by 

[$).(£)] :=(*i > *2)-(yi0'2) ./or eflxff, (5.8) 

where (• , • ) denotes the Hilbert space scalar product in H. Then the operator matrix stf 



C 

-C -AC 



is a normal operator in the Krein space (H x H, [•,•]). If the operator srf satisfies the condi- 
tions in Theorem \4.3\ then equation ( 15.7b has an operator root. 



Proof. Obviously, M 3 = H x H with inner product (15.8b is a Krein space and the adjoint of 
s$ with respect to [■ , ■] is given by 



C* 

-C* -AC* 



From this, we easily conclude — srf + £S? . If the operator satisfies the conditions in 

Theorem 14. 31 then si is a strongly stable normal operator in the Krein space (H x H, [■ , •]). 
Hence, there exists a fundamental decomposition (12. Il l such that Jif + and Jff- are invariant 
subspaces with respect to Let K . H —> H with \\K\\ < 1 be the corresponding angular 
operator, see, e.g., (TJ Chapter 1, §8], such that 

^ U J + ! :.v: :/-/ 



Now, g/Jtf + C implies that for every x+ € H there exists y+ e H with 

C&+ \ / y+ 
-Cx+-ACKx+ J \ Kyj, 

and we obtain 

C ACK = KCK. 
Multiplication by C from the right gives 

(KC) 2 +AC{KC)+C 2 = 0, 

and the operator KC is an operator root of (15.7) . □ 

Remark 5.2. If the operator pencil L(X) := A 2 + A AD + D 2 with D — ^(C + C*) is hyper- 
bolic, i.e. 

(AD*,*) 2 > 4(D 2 x,x) forallxetf, ||jc[| = 1, (5.9) 

and if is not an eigenvalue of D, then equation (15.7b has an operator root Z\ which commutes 
with Zi. To see this, we note that $53} implies (A 2 x,jc)||Dx|| 2 = ||Ajc|| 2 ||Dx|| 2 > (Ax,Dx) 2 > 
4||Dx|| 2 and hence A 2 — 4 > 0. Let W := (A 2 — 4) 1 / 2 . Now, a simple computation shows that 
both 

Z { :=^(W-A)C and Z 2 := ~(W +A)C 
are operator roots of (15. 7K Z1Z2 =Z2Z\ andL(A) = (A — Zi)(A — Zj). 
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